75 research outputs found

    Loc-NeRF: Monte Carlo Localization using Neural Radiance Fields

    Full text link
    We present Loc-NeRF, a real-time vision-based robot localization approach that combines Monte Carlo localization and Neural Radiance Fields (NeRF). Our system uses a pre-trained NeRF model as the map of an environment and can localize itself in real-time using an RGB camera as the only exteroceptive sensor onboard the robot. While neural radiance fields have seen significant applications for visual rendering in computer vision and graphics, they have found limited use in robotics. Existing approaches for NeRF-based localization require both a good initial pose guess and significant computation, making them impractical for real-time robotics applications. By using Monte Carlo localization as a workhorse to estimate poses using a NeRF map model, Loc-NeRF is able to perform localization faster than the state of the art and without relying on an initial pose estimate. In addition to testing on synthetic data, we also run our system using real data collected by a Clearpath Jackal UGV and demonstrate for the first time the ability to perform real-time global localization with neural radiance fields. We make our code publicly available at https://github.com/MIT-SPARK/Loc-NeRF

    Kimera: from SLAM to Spatial Perception with 3D Dynamic Scene Graphs

    Full text link
    Humans are able to form a complex mental model of the environment they move in. This mental model captures geometric and semantic aspects of the scene, describes the environment at multiple levels of abstractions (e.g., objects, rooms, buildings), includes static and dynamic entities and their relations (e.g., a person is in a room at a given time). In contrast, current robots' internal representations still provide a partial and fragmented understanding of the environment, either in the form of a sparse or dense set of geometric primitives (e.g., points, lines, planes, voxels) or as a collection of objects. This paper attempts to reduce the gap between robot and human perception by introducing a novel representation, a 3D Dynamic Scene Graph(DSG), that seamlessly captures metric and semantic aspects of a dynamic environment. A DSG is a layered graph where nodes represent spatial concepts at different levels of abstraction, and edges represent spatio-temporal relations among nodes. Our second contribution is Kimera, the first fully automatic method to build a DSG from visual-inertial data. Kimera includes state-of-the-art techniques for visual-inertial SLAM, metric-semantic 3D reconstruction, object localization, human pose and shape estimation, and scene parsing. Our third contribution is a comprehensive evaluation of Kimera in real-life datasets and photo-realistic simulations, including a newly released dataset, uHumans2, which simulates a collection of crowded indoor and outdoor scenes. Our evaluation shows that Kimera achieves state-of-the-art performance in visual-inertial SLAM, estimates an accurate 3D metric-semantic mesh model in real-time, and builds a DSG of a complex indoor environment with tens of objects and humans in minutes. Our final contribution shows how to use a DSG for real-time hierarchical semantic path-planning. The core modules in Kimera are open-source.Comment: 34 pages, 25 figures, 9 tables. arXiv admin note: text overlap with arXiv:2002.0628

    Fluoride Chemistry in Tin Halide Perovskites

    Get PDF
    Tin is the frontrunner for substituting toxic lead in perovskite solar cells. However, tin suffers the detrimental oxidation of SnII to SnIV. Most of reported strategies employ SnF2 in the perovskite precursor solution to prevent SnIV formation. Nevertheless, the working mechanism of this additive remains debated. To further elucidate it, we investigate the fluoride chemistry in tin halide perovskites by complementary analytical tools. NMR analysis of the precursor solution discloses a strong preferential affinity of fluoride anions for SnIV over SnII, selectively complexing it as SnF4. Hard X-ray photoelectron spectroscopy on films shows the lower tendency of SnF4 than SnI4 to get included in the perovskite structure, hence preventing the inclusion of SnIV in the film. Finally, small-angle X-ray scattering reveals the strong influence of fluoride on the colloidal chemistry of precursor dispersions, directly affecting perovskite crystallization

    Statistical Modeling of Single Target Cell Encapsulation

    Get PDF
    High throughput drop-on-demand systems for separation and encapsulation of individual target cells from heterogeneous mixtures of multiple cell types is an emerging method in biotechnology that has broad applications in tissue engineering and regenerative medicine, genomics, and cryobiology. However, cell encapsulation in droplets is a random process that is hard to control. Statistical models can provide an understanding of the underlying processes and estimation of the relevant parameters, and enable reliable and repeatable control over the encapsulation of cells in droplets during the isolation process with high confidence level. We have modeled and experimentally verified a microdroplet-based cell encapsulation process for various combinations of cell loading and target cell concentrations. Here, we explain theoretically and validate experimentally a model to isolate and pattern single target cells from heterogeneous mixtures without using complex peripheral systems.Wallace H. Coulter Foundation (Young Investigator in Bioengineering Award)National Institutes of Health (U.S.) (Grant R01AI081534)National Institutes of Health (U.S.) (Grant R21AI087107

    Fluoridchemie in Zinn‐Halogenid‐Perowskiten

    Get PDF
    Zinn ist der Top-Favorit für den Ersatz von giftigem Blei in Perowskit-Solarzellen. Allerdings kommt es dabei verstärkt zu der unerwünschten Oxidation von SnII zu SnIV. Die herkömmlichen Verfahren verwenden SnF2 in der Perowskit-Vorläuferlösung, um die Bildung von SnIV zu verhindern. Dennoch bleibt der Wirkmechanismus des Additivs unklar. Um diesen eingehender zu erläutern, untersuchen wir die Fluoridchemie in Zinn-Halogenid-Perowskiten mit einander ergänzenden Analyseverfahren. NMR-Spektroskopie der Vorläuferlösung offenbart eine stark bevorzugte Affinität der Fluoridanionen für SnIV gegenüber SnII, wodurch dieses selektiv als SnF4 komplexiert wird. Harte Röntgenphotoelektronenspektroskopie an Dünnschichten zeigt die geringere Bereitschaft von SnF4 gegenüber SnI4, in die Perowskit-Struktur eingebaut zu werden und verhindert somit den Einschluss von SnIV in der Dünnschicht. Abschließend offenbart Röntgen-Kleinwinkelstreuung den starken Einfluss vom Fluorid auf die kolloidale Chemie der Vorläuferlösungen, der sich direkt auf die darauffolgende Kristallisation auswirkt.European Research Council (ERC)Peer Reviewe

    Manganese Superoxide Dismutase: Guardian of the Powerhouse

    Get PDF
    The mitochondrion is vital for many metabolic pathways in the cell, contributing all or important constituent enzymes for diverse functions such as β-oxidation of fatty acids, the urea cycle, the citric acid cycle, and ATP synthesis. The mitochondrion is also a major site of reactive oxygen species (ROS) production in the cell. Aberrant production of mitochondrial ROS can have dramatic effects on cellular function, in part, due to oxidative modification of key metabolic proteins localized in the mitochondrion. The cell is equipped with myriad antioxidant enzyme systems to combat deleterious ROS production in mitochondria, with the mitochondrial antioxidant enzyme manganese superoxide dismutase (MnSOD) acting as the chief ROS scavenging enzyme in the cell. Factors that affect the expression and/or the activity of MnSOD, resulting in diminished antioxidant capacity of the cell, can have extraordinary consequences on the overall health of the cell by altering mitochondrial metabolic function, leading to the development and progression of numerous diseases. A better understanding of the mechanisms by which MnSOD protects cells from the harmful effects of overproduction of ROS, in particular, the effects of ROS on mitochondrial metabolic enzymes, may contribute to the development of novel treatments for various diseases in which ROS are an important component

    Nothing Lasts Forever: Environmental Discourses on the Collapse of Past Societies

    Get PDF
    The study of the collapse of past societies raises many questions for the theory and practice of archaeology. Interest in collapse extends as well into the natural sciences and environmental and sustainability policy. Despite a range of approaches to collapse, the predominant paradigm is environmental collapse, which I argue obscures recognition of the dynamic role of social processes that lie at the heart of human communities. These environmental discourses, together with confusion over terminology and the concepts of collapse, have created widespread aporia about collapse and resulted in the creation of mixed messages about complex historical and social processes

    Global, regional, and national incidence, prevalence, and years lived with disability for 354 diseases and injuries for 195 countries and territories, 1990–2017: A systematic analysis for the Global Burden of Disease Study 2017

    Get PDF
    Background: The Global Burden of Diseases, Injuries, and Risk Factors Study 2017 (GBD 2017) includes a comprehensive assessment of incidence, prevalence, and years lived with disability (YLDs) for 354 causes in 195 countries and territories from 1990 to 2017. Previous GBD studies have shown how the decline of mortality rates from 1990 to 2016 has led to an increase in life expectancy, an ageing global population, and an expansion of the non-fatal burden of disease and injury. These studies have also shown how a substantial portion of the world's population experiences non-fatal health loss with considerable heterogeneity among different causes, locations, ages, and sexes. Ongoing objectives of the GBD study include increasing the level of estimation detail, improving analytical strategies, and increasing the amount of high-quality data. Methods: We estimated incidence and prevalence for 354 diseases and injuries and 3484 sequelae. We used an updated and extensive body of literature studies, survey data, surveillance data, inpatient admission records, outpatient visit records, and health insurance claims, and additionally used results from cause of death models to inform estimates using a total of 68 781 data sources. Newly available clinical data from India, Iran, Japan, Jordan, Nepal, China, Brazil, Norway, and Italy were incorporated, as well as updated claims data from the USA and new claims data from Taiwan (province of China) and Singapore. We used DisMod-MR 2.1, a Bayesian meta-regression tool, as the main method of estimation, ensuring consistency between rates of incidence, prevalence, remission, and cause of death for each condition. YLDs were estimated as the product of a prevalence estimate and a disability weight for health states of each mutually exclusive sequela, adjusted for comorbidity. We updated the Socio-demographic Index (SDI), a summary development indicator of income per capita, years of schooling, and total fertility rate. Additionally, we calculated differences between male and female YLDs to identify divergent trends across sexes. GBD 2017 complies with the Guidelines for Accurate and Transparent Health Estimates Reporting. Findings: Globally, for females, the causes with the greatest age-standardised prevalence were oral disorders, headache disorders, and haemoglobinopathies and haemolytic anaemias in both 1990 and 2017. For males, the causes with the greatest age-standardised prevalence were oral disorders, headache disorders, and tuberculosis including latent tuberculosis infection in both 1990 and 2017. In terms of YLDs, low back pain, headache disorders, and dietary iron deficiency were the leading Level 3 causes of YLD counts in 1990, whereas low back pain, headache disorders, and depressive disorders were the leading causes in 2017 for both sexes combined. All-cause age-standardised YLD rates decreased by 3·9% (95% uncertainty interval [UI] 3·1-4·6) from 1990 to 2017; however, the all-age YLD rate increased by 7·2% (6·0-8·4) while the total sum of global YLDs increased from 562 million (421-723) to 853 million (642-1100). The increases for males and females were similar, with increases in all-age YLD rates of 7·9% (6·6-9·2) for males and 6·5% (5·4-7·7) for females. We found significant differences between males and females in terms of age-standardised prevalence estimates for multiple causes. The causes with the greatest relative differences between sexes in 2017 included substance use disorders (3018 cases [95% UI 2782-3252] per 100 000 in males vs 1400 [1279-1524] per 100 000 in females), transport injuries (3322 [3082-3583] vs 2336 [2154-2535]), and self-harm and interpersonal violence (3265 [2943-3630] vs 5643 [5057-6302]). Interpretation: Global all-cause age-standardised YLD rates have improved only slightly over a period spanning nearly three decades. However, the magnitude of the non-fatal disease burden has expanded globally, with increasing numbers of people who have a wide spectrum of conditions. A subset of conditions has remained globally pervasive since 1990, whereas other conditions have displayed more dynamic trends, with different ages, sexes, and geographies across the globe experiencing varying burdens and trends of health loss. This study emphasises how global improvements in premature mortality for select conditions have led to older populations with complex and potentially expensive diseases, yet also highlights global achievements in certain domains of disease and injury

    The impact of surgical delay on resectability of colorectal cancer: An international prospective cohort study

    Get PDF
    AIM: The SARS-CoV-2 pandemic has provided a unique opportunity to explore the impact of surgical delays on cancer resectability. This study aimed to compare resectability for colorectal cancer patients undergoing delayed versus non-delayed surgery. METHODS: This was an international prospective cohort study of consecutive colorectal cancer patients with a decision for curative surgery (January-April 2020). Surgical delay was defined as an operation taking place more than 4 weeks after treatment decision, in a patient who did not receive neoadjuvant therapy. A subgroup analysis explored the effects of delay in elective patients only. The impact of longer delays was explored in a sensitivity analysis. The primary outcome was complete resection, defined as curative resection with an R0 margin. RESULTS: Overall, 5453 patients from 304 hospitals in 47 countries were included, of whom 6.6% (358/5453) did not receive their planned operation. Of the 4304 operated patients without neoadjuvant therapy, 40.5% (1744/4304) were delayed beyond 4 weeks. Delayed patients were more likely to be older, men, more comorbid, have higher body mass index and have rectal cancer and early stage disease. Delayed patients had higher unadjusted rates of complete resection (93.7% vs. 91.9%, P = 0.032) and lower rates of emergency surgery (4.5% vs. 22.5%, P < 0.001). After adjustment, delay was not associated with a lower rate of complete resection (OR 1.18, 95% CI 0.90-1.55, P = 0.224), which was consistent in elective patients only (OR 0.94, 95% CI 0.69-1.27, P = 0.672). Longer delays were not associated with poorer outcomes. CONCLUSION: One in 15 colorectal cancer patients did not receive their planned operation during the first wave of COVID-19. Surgical delay did not appear to compromise resectability, raising the hypothesis that any reduction in long-term survival attributable to delays is likely to be due to micro-metastatic disease
    corecore